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We consider the problem of the optimal compression rate 
in the case of the source producing mixed signal states within 
the visible scheme (where Alice, who is to compress the signal, 
can know the identities of the produced states) . We show that 
a simple strategy based on replacing the signal states with 
their extensions gives optimal compression. As a result we 
obtain a considerable simplification of the formula for optimal 
compression rate within visible scheme. 
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Given a quantum source, what is the minimal num- 
ber of quantum resources needed for faithful transmis- 
sion of the states produced by the source? This quan- 
tum analogue of the problem of data compression |l]] 
was stated for the first time by Schumacher Q, It has 
been solved for stationary memoryless sources generating 
pure states 0-0]. In general, the stationary memoryless 
sources are described by ensemble {pi,Qi}. This means 
that the source emits system in state gi with probability 
Pi (one can of course generalize it by considering proba- 
bility measure on the set of states) . The lack of memory 
implies that the state of the sequence of systems emit- 
ted by the source is in product state ® • • • <8 Qi N and 
probability of emission of such string is product of suit- 
able probabilities pi t . . . pi N . Henceforth we will deal with 
such kind of sources. 

It appears, that for pure signal states gi, the minimal 
number of qubits allowing faithful recovery of the input 
states is equal to the von Neumann entropy of the den- 
sity matrix of ensemble g — 'Y2 i Pigi ||. Then the von 
Neumann entropy has clear interpretation within purely 
quantum communication theory. 

In the case of gt being impure the problem is unsolved. 
Apart from some particular cases we do not know much 
about optimal compression of ensembles of mixed states. 
The scheme that succeeded in the pure states case can be 
also applied in the present case, compressing the signal 
down to the von Neumann entropy. However, one knows 
that in many cases it is not optimal compression 0. A 
good candidate for the minimal number of qubits in this 
general case could be the Levitin-Holevo function m of 
ensemble I LH = S(J2iPi9i) - J2iPiS(&i) where S is von 
Neumann entropy. Indeed, in this quantity the lost of 
information caused by impurity of signal states is taken 
into account by subtracting their mean entropy. As a 
matter of fact, it has been proven ||^J that It,h is lower 
bound for the needed number of qubits. However a very 
difficult problem, whether this rate of compression can 



be reached remains still unsolved. Additional motivation 
to consider this problem is that one would like to know 
whether It,h has interpretation in terms of qubits (so far 
it has the interpretation in terms of capability of sending 
classical bits via quantum states [T^-|T^]). 

In general, the scheme of compression is as follows. 
Alice (who is to compress the signal) waits for a long 
sequence of the systems generated by the source. Then 
she performs some operation on the sequence. Her aim is 
to decrease the support of the total density matrix of the 
ensemble of sequences (the least Hilbert space the matrix 
lives on), as the number of needed qubits is equal to the 
logarithm of the dimension of the support. However, she 
must do it in a clever way, in order not to disturb the 
signal too much, so that Bob would be able to recover it 
with high fidelity. 

There are two basic schemes of compression. In the 
first one, called blind, Alice does not know the identities 
of the produces states. Then all she can do is to ap- 
ply some quantum operation, independent of the input 
states. If, instead, she knows the identities of the states 
(visible scheme) her operation can be state-dependent, 
so that she has more possibilities. Of course, Bob does 
not know the identities of signal states in either case, 
so that his operation is always state-independent. Thus, 
in general, the compression could be better within the 
visible scheme. The optimal compression rate for pure 
signal states appears to be independent of the kind of 
applied scheme j|. For mixed state case, the answer is 
not known. In both schemes to obtain the optimal com- 
pression rate, one must perform optimization over Alice 
and Bob actions satisfying the condition of high fidelity 
of transmission. All that must be performed in the limit 
of long sequences. Thus the task is exceedingly difficult. 

In one of the attempts to solve the problem, a sim- 
ple visible protocol of compression was proposed jl3|,[§. 
Namely, Alice can replace the signal states |l5j with their 
purifications [|14| , applying then Schumacher (or Jozsa- 
Schumacher pf) compression protocol to the resulting 
ensemble of pure states. More generally ^ Alice can 
replace signal states with their extensions (by extension 
of a state a we mean another state that, partially traced, 
reproduces er) that are not necessarily pure. This replace- 
ment aims at decreasing the von Neumann entropy S of 
the density matrix of the initial ensemble to some lower 
value S". If it is possible, then the subsequent Jozsa- 
Schumacher (JS) protocol will compress the signal at rate 
S' qubits/message, hence with better performance than 
in the case of direct application of the protocol, resulting 
in S qubits/message. 
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In this paper we consider visible scheme. We prove 
that the above very simple strategy provides optimal 
compression rate. More precisely, to compress the signal 
optimally, Alice should replace the sequences of signal 
states with their extensions chosen in such a way that 
the von Neumann entropy of the resulting ensemble is 
minimal. As a result, we obtain a considerable simplifi- 
cation of the formula for optimal compression rate. The 
very tedious task of optimization is now reduced to min- 
imization of the von Neumann entropy of the ensemble 
of extensions. 

Let us now introduce some notation (the same as in 
Ref. Q). Suppose that the source generates a system in 
state g° acting on a Hilbert space Hq with probability 
p®. The produced ensemble £q = {p®, p?} has the density 
matrix g° = J2iPi@i- Denote the product ® . . . ® g° N 
by ft, where i stands now for multi- index (to avoid com- 
plicated notation we do not write the index N explic- 
itly unless necessary). The corresponding ensemble and 
state are denoted by £ and g respectively. Now Alice 
performs a coding operation over the initial ensemble £ 
ascribing to any input state ft a new state ft. The map 
ft — *■ Qi — A^(ft) is supposed to be a quantum operation 
i.e. linear completely positive trace-preserving map for 
blind scheme or an arbitrary map - for visible one. In the 
latter case we allow Alice to know which states are gen- 
erated by the source, so that she can prepare separately 
each of the states ft for each i. 

The new states ft represent the compressed signal that 
is then flipped onto the suitable number of qubits deter- 
mined by the dimension of subspace occupied by the to- 
tal state g of the ensemble and sent through the noiseless 
channel to Bob. Now the states ft are to be decom- 
pressed to become close to the initial states ft. For this 
purpose Bob performs some established quantum opera- 
tion A which of course does not depend on i. Then the 
resulting states are g' i = As (ft) and the total scheme is 
the following 



compression 
ft — "> 
Aa 

decompression 
As 



noiseless channel 
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where ft and g[ act on the Hilbert space Ti.Q N while ft 
on the channel Hilbert space He- Now we should de- 
termine the measure of quality of transmission ft — > g[. 
As one knows, there exist many different metrics on the 
set of mixed states. The most common ones are Hilbert- 
Schmidt distance D^_ s (g,a) = Tr(g — cr) 2 , the one in- 
duced by trace norm \\g — a\\ = Tr|^ — a| and the Burcs 



metric D B = 2- y/F(g, cr), where the fidelity F QT^ 
is given by 



F(g,a) = 



Tr \Ufgo-yfg 
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fidelity. The latter has an appealing property: if one of 
the states (say g) is pure then it is of the form 



(3) 



In this case the fidelity has a clear interpretation as prob- 
ability that the state a passes the test of being ijj. The 
fidelity was used in the problem of compression of quan- 
tum information |2|-^j|, and it is now an important tool 
in quantum information theory. However some results 
were obtained by use of other measures of quality of 
transmission. To the author knowledge, there is no spe- 
cial discrepancy among the results obtained via different 
metrics. In fact, it is yet not clear whether and to what 
extent different metrics could lead to non-equivalent con- 
clusions. In this paper we will use fidelity, partially due 
to one of its properties being especially useful in the con- 
text of the problem of extensions we are dealing with. 
Namely fl(||l7j the fidelity can be expressed in the fol- 
lowing way 



F(a, ft)=max|(V#)| 2 



(4) 



where <$> is arbitrary purification of a and the maximum 
runs over all possible purifications of g. As we will see fur- 
ther, this property allows to prove an important lemma. 

Consequently, the average fidelity F (£,£') = 
*52iPiF{gi, g'i) will indicate us the quality of the pro- 
cess of recovery of quantum information by Bob after 
compression by Alice. Now, for a fixed source deter- 
mined by the ensemble £$, one considers the sequence 
of compression-decompression pairs (A^A^) with the 
property that 
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lim F(£,£') = 1 
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(recall that the pair is implicitly indexed by N). Such 
sequences will be called protocols. 

Define now the quantity Rp characterizing the asymp- 
totic degree of compression of the initial quantum data 
at a given protocol P by 



Rp = lim — logdimp 



(6) 



Here dimg denotes the dimension of the support of the 
state g given by the number of its nonzero eigenvalues. 
The quantity log dimg has the interpretation of the num- 
ber of qubits needed to carry the state g undisturbed (q is 
to be transferred through a noiseless channel). Actually, 
only one of the signal sequences ft is being transmitted 
at a time. However, it is easy to see, that dimp is the 
minimal dimension that guarantees transmission of any 
of the states ft without disturbance. 

Now, given a class V of protocols, we define the quan- 
tity 



Instead of Bures metric, one usually uses directly the 
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inf R P 

pep 
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which is equal to the least number of qubits per system 
needed for asymptotically faithful transmission of the ini- 
tial signal states from Alice to Bob within the considered 
class of protocols (to be strict one needs I-p + 5 qubits 
per message, where 5 can be chosen arbitrarily small). 
Now, if V is the set of visible protocols, the Ip is called 
effective information carried by the ensemble [^) and is 
denoted by I e ff (optimal rate within the class of blind 
protocols is called passive information). As one can see, 
the definition of the effective information, even though 
physically natural, is very complicated from mathemati- 
cal point of view. One must optimize the limit (^|) over 
the Alice and Bob actions keeping satisfied the condition 
(|J) at the same time. Moreover, the definition does not 
give any intuition on how the structure of ensemble could 
be related to its effective information content. 

Let us now try to reduce the problem to obtain more 
transparent form of the effective information. Consider 
the most general compression-decompression protocol. 
Any Bob's operation, as a completely positive trace- 
preserving map, amounts to (i) adding ancilla in some 
pure state, (ii) performing unitary transformation over 
the total system and (iii) performing partial trace [ jl8| . 
Now, the two first stages can be incorporated into Alice 
action. Then decompression will amount only to per- 
forming partial trace. Of course, the new protocol will 
give the same rate of compression as the previous one, 
because both stages do not change the dimension of the 
support of a state. Thus we can consider optimal proto- 
col in the following form 



compression 
Aa 



text decompression 

°i ► 

A r —Tr anc 



(8) 



where g'^ x are some extensions of the state g\ and they 
act on the Hilbert space n^ N ® Hanc (in the following, 
the extensions of a state a will be denoted by a ext ). Then 
the optimal compression rate is given by 



I e ff = lim — log dimp' 

n Jy 



(9) 



We will need the following lemma. 

Lemma. Let g, g' act on space TLq N and let g' ext , 
acting on TCq N ® Hanc be extension of g'. Then there 
exists a state g ext acting on Hq™ ® H anc such that (a) 
g ext is an extension of g (b) F(g ext 1 g' ext ) — F(g, g'). 

Proof. Let H ex t = Uq N O U anc and let ft € 

Hext ® Hpur be purification of g' ext . Then it is also 
purification of the state g' . From the formula (Q) we 
obtain that there exists some purification <f> of g such 
that F(g,g') = \{ft\ft)\ 2 . Now we can take g ext = 
Tru pur 1^) (01- Using the formula (||) once more, we get 
F(g ext ,g' ext ) > \(ft\ft)\ 2 = F(g,g'). Since the fidelity 
does not decrease under partial trace p3] (this can be 
easily seen from (J3) ) , we obtain F(g ext , g' ext ) = F(g, g').. 
Let us now formulate the main result of the paper. 



Theorem. Let £ ext = {pi,gf xt } with g ext being ex- 
tensions of the signal states ft; let g ext be the total den- 
sity matrix of ensemble £ ext . Then the optimal compres- 
sion rate within the visible scheme is given by 



/„„= Jimlinf^-) 



(10) 



where the infimum runs over the set of ensembles £ ext . 

Remarks. (1) Since one can choose trivial Hanc 
{Hanc — C), gi itself is the extension of gi, too. (2) One 
can show that the limit on the right hand side of the 
equality ([[o|) exists. Indeed, it follows from the fact that 
if a sequence {a n } satisfies a„ < kn for some k and 
a n + a m > a n+m for any m, n, then a n /n is convergent 

Proof. To prove that the formula (|10|) is valid, we 
must first provide the protocol that achieves such rate, 
and then show that the latter is equal to the optimal rate 
given by (g). 

To this end, consider the following concatenated pro- 
tocol (cf. Ref. §) (call it extension protocol and denote 
by EP). Alice replaces the signal state with the state 



or 



and then applies the JS protocol P[. The number 



of needed qubits per system is now equal to the entropy 
of the density matrix of the new ensemble. As JS proto- 
col needs no decompression || , Bob has only to perform 
partial trace to come back to the original space Hq N ■ 
Then, the overall scheme is the following 



<g> . . . ® g lk 



Q ext ® 



Bob's 
/ ext partial trace 



(11) 



Here ij's are multi-indices of length N; g^ eg) 
and g' ix t act on the Hilbert space (Hq N ) while 



) 



(8) ~g\f and gf xt ik 



act on [H^ ® H anC j 
The former two states can be obtained from the latter 
ones by tracing over the space Hf^c- Now, as it was 
mentioned, the fidelity does not decrease under partial 
trace. Then (as in Ref. § for different transmission qual- 
ity measure) we obtain that average fidelity produced by 
the composed protocol is greater than or equal to the 
one within the "intermediate" JS compression protocol. 
The latter fidelity tends to one if N is kept fixed and 
k tends to infinity (of course, TV, although fixed, can be 
chosen arbitrarily large) . Thus the total protocol satisfies 
asymptotic fidelity condition (^). 

Since the JS protocol compresses the signal down to 
the von Neumann entropy of the ensemble, the extension 
protocol has compression rate equal to 



Rep= lim ±-S(g ext ) 

N~>co N 



(12) 



Minimizing this expression over all possible extensions 
of signal states we obtain the rate of optimal extension 
protocol (OEP) 



3 



Roep — inf Rep = hm — inf SYp 6 

BP jV-»oo N 



(13) 



Now we must show that Roep < -^e//- To this end 
consider the optimal protocol of the form (||) so that 
I e ff is given by equation (^J). Then it suffices to find 
such extensions g ext that 

lim ^S(g ext ) < lim 1 logdimp'^ 4 . (14) 

The suitable extensions are suggested by the lemma. 
Namely, suppose that N is large, so that F(£ , £') > 1 — e 
(within the considered optimal protocol). Then, by 
the lemma there exist extensions gf xt of Qi such that 
F(£ ext ,£' e 2) > 1 - e. Now we can use the inequality 
proved in p2 ] (which is similar to the Fannes inequality 
p3]|) saying that for states acting on Hilbert space H we 
have 



likely, that collective extensions of long signal sequences 
are necessary to obtain optimal compression. 

We believe that the presented result will stimulate 
to answer these questions, to find whether the Levitin- 
Holevo function has physical sense in terms of quantum 
bits, and eventually, to resolve the highly nontrivial prob- 
lem of compression of quantum information carried by 
ensembles of mixed states. 
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\S(g) - S(g')\ < 2 log dirndl - F(g, 7) + 1 (15) 

if only F(g, g') > 1 — By double concavity of square 
of F 19(1 we obtain in our case that 



^\S(g ext )-S(g' ext )\< 
4(logdinxft Q + — logdimW anc )Ve 



1 

N 



(16) 



One can show |24j that it suffices to consider H an c sat- 
isfying logdim7i anc < 2N log dimT^Q . Thus the entropy 
(per system) of the state g ext is asymptotically equal to 
the one of g' ex . Now, since S(g' ex ) < \og&\mg' ex we 
obtain the inequality (|l4|). | 

To summarize, we obtained much simpler formula for 
optimal compression rate in visible coding scheme. So far 
the task was to minimize the support of the states under 
Alice and Bob operations constrained by the asymptotic 
high fidelity condition. The latter is very difficult to deal 
with in the case of mixed states. The present expression 
does not involve such constraint, nor it involves Alice and 
Bob actions. Now one needs minimize entropy (which is 
more feasible than dealing with dimension of the sup- 
port) varying over extensions of the ensemble. Thus the 
constraints are now much more convenient. An inter- 
esting question arises: Can the optimal compression be 
achieved by means of pure extensions (purifications)? A 
closely related question is: Given an ensemble, do there 
exist such purifications, that the entropy of the purifica- 
tion ensemble is not greater than the entropy of the initial 
one? If it is not the case in general, can it be asymptot- 
ically true for typical sequences of states? Finally, one 
could ask, whether the limit in the formula ( |Toj ) is really 
needed. It might be the case that the minimal entropy 
could be attained by means of extensions of single signals 
g®. However, almost everywhere in quantum information 
theory the collective operations are much more powerful 
than the ones performed on separate systems. Then it is 
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